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Abstract 

This paper presents a fully distributed power allocation algorithm for decode-and-forward (DF) relay 
networks with a large number of sources, relays, and destination nodes. The well known mathematical 
decomposition based distributed optimization techniques cannot directly be applied to DF relay networks, 
because the achievable rate of DF relaying is not strictly concave, and thus the local power allocation 
subproblem may have non-unique solutions. We resolve this non-strict concavity problem by using the 
idea of proximal point method, which adds some quadratic terms to make the objective function strictly 
concave. While traditional proximal point methods require a two-layer nested iteration structure, our 
proposed algorithm has a single-layer iteration structure, which is desirable for on-line implementation. 
Moreover, our algorithm only needs local information exchange among the source, relay, and destination 
nodes of each DF relay link, and can easily adapt to variations of network size and topology. In this paper, 
we establish the convergence and optimality of our fully distributed single-layer iterative algorithm. 
Numerical results are provided to illustrate the benefits of our proposed algorithm. 
Index terms— Decode-and-forward, distributed power allocation, wireless relay network. 

The material in this paper was presented in part in IEEE GLOBECOM 2009. 

f Y. Sun, X. Zhong and S. Zhou were with the State Key Laboratory on Microwave and Digital Communications, Tsinghua 
National Laboratory for Information Science and Technology, and Department of Electronic Engineering, Tsinghua University, 
Beijing, China. Address: Room 4-407, FIT Building, Tsinghua University, Beijing 100084, People's Republic of China. Yin Sun 
is now with the Department of Electrical and Computer Engineering, the Ohio State University, Columbus, Ohio 43210, USA. 
e-mail: sunyin02@gmail.com, {zhongxf,zhousd}@tsinghua.edu.cn. 

J Z. Mao and N. B. Shroff are with Departments of ECE and CSE, The Ohio State University, e-mail: maoz@ece.osu.edu, 
shroff@ece.osu.edu. 

* Y. Xiao is with Department of EE, University of California, Los Angeles, e-mail: xyz.xiao@gmail.com. 



January 4, 2012 



DRAFT 



2 




I. Introduction 

Cooperative relaying has recently received a lot of attention as a promising technique to 
improve the throughput, coverage, and reliability of wireless networks JH, ED- Specifically, the 
decode-and-forward (DF) relay strategy has been advocated by several standard organizations 
for next generation wireless networks fl3j — flSl . In this strategy, the relay node decodes the source 
node's transmission message, then forwards the recovered message to the destination. Recent 
wireless applications of DF relaying include sensor networks [|6]|, ad-hoc networks 0, cellular 
networks [8], user-provided networks flU, offshore networks [TTOl . and satellite networks [[mi . 
etc. 

Since power is a crucial resource in wireless networks, a number of studies have investigated 
the allocation of power resource for DF relay networks. They have shown that optimal power 
allocation can achieve significant performance improvement for DF relay networks with a sin- 
gle data stream between the source and destination nodes [[T2 | -[[22 | . However, optimal power 
allocation becomes much more challenging for DF relay networks with many data streams, 
because each data stream may cooperate with several relay nodes. Furthermore, these relay 
nodes can serve other data streams, as shown in Fig [Q Hence, different data streams in the 
network are intertwined with each other, which makes the power allocation problem much more 
complicated. Centralized power allocation for relay networks was studied in |[23l - [|26l . which 
requests signaling mechanisms to gather the channel state information (CSI) of all the wireless 
links at a central control node. However, such mechanisms are difficult to implement in practice 
and will especially not work well when the network size is large. 

Recently, a great deal of research efforts have focused on distributed power allocation for DF 
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relay networks: Traditional two-hop relaying was considered in [|27l - [|29l , which ignores the 
source-destination wireless channel, and thus achieves a lower data rate. In Il30ll - ll32ll . several 
conservative assumptions of the achieve data rate of DF relaying were made to simplify the 
distributed power allocation problem and make it tractable. Optimal power allocation of the 
relay nodes was studied in Il23l - ll26l . Il33l without considering power allocation at the source 
node. Optimal distributed power allocation for DF relay networks has remained a difficult and 
crucial problem. 

Mathematical decomposition techniques have been effectively used in multi-hop wireless 
networks to achieve joint optimal power allocation results (e.g., see ll34l and the references 
therein). However, such techniques cannot be applied directly to DF relay networks — the 
local power allocation subproblems may have many optimal solutions, because the achievable 
rate of DF relaying is not strictly concave with respect to the transmission power. Since no 
global network information is available to the local power allocation subproblems, it is quite 
difficult to find a global feasible solution among all the locally optimal solutions ll35l . Il36ll . 

One promising method to address this non-strict concavity problem is the proximal point 
method lt37l . which adds strictly concave terms to the achievable rate function without affecting 
the optimal solution. However, typical proximal point algorithms require a two-layer nested 
iteration structure, where each outer-layer update can proceed only after the inner-layer iterations 
converge 11371 . Such a structure is not suitable for distributed implementation, because it is 
difficult to decide in a distributed manner when the inner-layer iterations can stop. 

This paper investigates distributed power allocation for DF relay networks with a large number 
of sources, relays, and destination nodes. Each source node may transmit to several destinations 
through the assistance of several relay nodes. Meanwhile, each relay node can serve several 
data streams (see Fig. [T]). We assume that each of the source and relay nodes has an individual 
transmission power constraint. We propose a fully distributed algorithm, which jointly optimizes 
the power allocation of the source and relay nodes. The proposed algorithm has the following 
attractive features: Firstly, the algorithm has a single-layer iteration structure, which is desirable 
for on-line implementation. Secondly, this algorithm only needs local information exchange 
among the source, relay, and destination nodes of each DF relay link, and thus can easily 
adapt to variations of network size and topology. Finally, the convergence and optimality of this 
algorithm is rigorously established without using any conservative data rate of DF relaying. 
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The proposed power allocation algorithm is motivated by the work in |[58l , where a single-layer 
proximal point algorithm was proposed for multi-path routing problems. However, the structure 
of the objective function in that work is very different from our work that deals with DF relay 
networks. Hence, a substantially new proof methodology is required to show convergence in our 
context, which is one of the major contributions of this paper. 

The remaining parts of this paper are organized as follows: In Section HH we present the 
system model and the formulation of power allocation problem. In Section [nil we describe 
our distributed power allocation algorithm. Numerical results are shown in Section [TV] and we 
conclude in Section [V] 

II. System Model and Problem Formulation 

Consider a DF relay network with N source/destination nodes, denoted by the set IN" = 
{1, 2, . . . , N}, and J relay nodes, represented by the set S = {1,2,..., J}. Each source- 
destination data stream in the network is denoted as m = (s, d) with s, d G N. The set of 
all data streams is denoted by M C e N, z ^ j}. The mth data stream is assisted 

by J{m) relay nodes, which are represented by the set #(m) C We assume that the direct 
transmission (DT) link and DF relay links of each data stream operate over orthogonal wireless 
channels as in 1231, 11551. 

In practice, wireless networks operate in a half-duplex mode, which means that they transmit 
and receive signals over different time/frequency channels [[121. O, 11551 . Owing to this, the 
DF relay process consists of 2 phases: In Phase 1, the source node transmits a message to the 
relay and destination nodes. The relay node decodes its received message, while the destination 
stores its received signal for later decoding. In Phase 2, the relay node forwards the recovered 
message to the destination. The destination combines its received signals in two phases to decode 
the source node's message 0. Let h^f denotes the complex channel coefficient of the source- 
destination wireless link of data stream m, and h 7 ^ denote the complex channel coefficients 
of the source-relay and relay-destination links of the DF relay link composed by data stream m 
and relay node j. 

The spectrum efficiency of the DT link of data stream m is given by the capacity of Gaussian 
channel, i.e., 

iC=Oog 2 (l + «) =*-lo g2 (l+«L) (1) 
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Fig. 2. Illustration of decode-and-forward relay strategy. 
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where P^ > is transmission power of the source node, 6% is the corresponding proportion 
of time/frequency channel resource, W is the total amount of available channel resource, N is 
power spectral density of the Gaussian noise at each receiver, and g^f = characterizes the 
quality of the source-destination wireless channel of the mth data stream, as shown in Fig. [2] 
The spectrum efficiency achieved by the DF relay link composed by data stream m and relay 
node j can be described as 0: 
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where Pi,„-,PJL- > are transmission powers of the source and relay nodes, 9%J is the cor- 
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responding proportion of time/frequency channel resource, g^j 
characterize the quality of the source-relay and relay-destination wireless channels of this DF 
relay link. If g s ^- < g^f , one can simply show that R®J < R m T , which indicates that DF relaying 
can not achieve a higher data rate than direct transmission without relay nodes. Therefore, we 
assume that g^ > g^ d is satisfied for all the J(m) relay nodes of data stream m. 

Let s(m) represent the source node of data stream m. Then, the power constraint of source 
node / over all the channels can be determined as 



{m\s(m)=l} 
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is the maximal transmission power of source node I. The power constraint of relay 
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node j is expressed as 



pr < pr 



j,maxi 
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where P£ max is the maximal transmission power of relay node j. The power allocation problem 
of the DF relay network is formulated as 
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The achievable rates i?^ T and Pwf are both concave in their transmission power variables. 
Therefore, the power allocation problem (P) is a convex optimization problem. However, as 
we have mentioned earlier, the achievable rate of DF relaying R^J is not strictly concave. 
Specifically, R^J is linear in the transmission power variables P^-,P^ in two cases: When 
Pmjdmj < Pmj9 S m + ^mjdmj holds, the achievable rate R^J in © does not vary with respect 
to P T mj . Moreover, if P s mj g s ^ > P r s rij g s ^ d + P^g^ holds and the value of P^gpf + P^g 7 ^ is 
fixed, ERf maintains the same value as PL, varies. 

In dual decomposition based distributed optimization techniques, it is quite difficult to recover 
the optimal primal variables (i.e. the transmission power variables P* •, PL^X if the objective 
function is non-strictly concave ll30ll . Il35l . Il36ll . 11391 . The dual variables can converge to the 
optimal solution to the dual problem. However, the primal variables may oscillate forever and 
never result in a feasible solution ll38l : see Remark 4 for more details. In the next section, we 
develop a distributed power allocation algorithm to address this non-strict concavity difficulty, 
and then prove its convergence to the optimal solution. 



III. Distributed Resource Allocation Algorithm 

To circumvent this non-strict concavity difficulty, we use the idea of proximal point method 
11371 . which is to add some quadratic terms and make the objective function strictly concave in 
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the primal variables. However, a standard proximal point method will not be effective because it 
relies on a two-layered nested iteration structure. Such a structure is not suitable for distributed 
implementation, because it is difficult to decide in a distributed manner when the inner-layer 
iterations have converged. We will overcome this difficulty by developing a single-layer fully 
distributed algorithm, which converges to the optimal solution. We provide the details as below. 



A. Single-layer Distributed Resource Allocation Algorithm 

The original problem (P) is modified as the following problem with more variables: 
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where Q^, •, and are auxiliary variables corresponding to P^, P* ., and P^-, respectively. 
It is easy to show that the optimal value of (|4aT ) coincides with that of <f3ab ||371 . In fact, let P* 
denote the maximizer of (P), then P = P*, Q = P* maximize ©. Moreover, problem © is 
strictly concave with respect to the transmission power variables P^,P^-, and P m y Small c m 
and c„ y indicates that the new problem © is close to the original problem (P), while large c m 
and c m j suggests that the new problem is more strict concave. In the sequent, we solve problem 
© instead of the original problem (P). 

Conventionally, the proximal point method requires a two-layer nested optimization structure 
ll37l . The inner-layer of the algorithm optimizes the original primal variables, while the outer- 
layer updates the introduced auxiliary variables. Each outer-layer update can proceed only after 
the inner-layer iterations converges, so as to assure the convergence of the algorithm. However, as 
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mentioned before, such a nested iteration structure is not conducive to distributed implementation. 
When the network is large, there is no distributed way to know when the inner-layer iterations can 
stop. To address this difficulty, a modified proximal point algorithm with a single-layer iteration 
structure was proposed in ||38l for the multi-path routing problem. However, the arguments of 
ll38l are quite specific to the structure of the objective function, and do not apply to our problem 
©. 

Let fii and Uj be the Lagrange multipliers associated with the constraints in (l4bl) and (l4cl) . 
respectively. The partial Lagrangian of problem © with respect to the power constraints (l4bl) 
and (l4cl) is given by 
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For convenience, we rearrange the above Lagrangian as 

l(P,Q;P] 

=R (p)-\ (P-Q) T V (P-Q)-u t [EP-P n 



(6) 



where R(P) is the objective function of problem (P), P is a M + 2^ m=1 J(m) dimensional 
vector representing the power allocation variables P^, P^-, and P^, Q is a M + 2 £!m=i ^( m ) 
dimensional vector representing the auxiliary variables Q s m ,Q s m p and <2^, -P ma x is a A^ + J 
dimensional vector representing the maximal transmission power P z s max and P[ m£kX , v is a A" + 
J dimensional vector representing the dual variables \ii and z/j, and E is (AT + J) x (M + 
2 J2m=i J{ m )) dimensional vector representing the relationship between the transmitting power 
variables and corresponding source/relay nodes. 
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Our proposed distributed power allocation algorithm is described as follows: 
Algorithm A: In the kth iteration, 
(Al) Suppose x(k) is the optimal power allocation solution for fixed u(k), Q(k): 

x(k) — argmaxL (P, Q{k); v{k) ) . (7) 
p>o ^ ' 

Update the dual variables v{k + 1) as 

u(k + 1) = [v{k) + A \Ex{k) - P max ] } + , (8) 

where A is a (N + J) x (N + J) dimensional diagonal matrix with diagonal elements 
«/ (7 = 1, 2, • • • ,N+J) as the step-size of dual updates, and (-) + = max{-, 0}. 
(A2) Update the auxiliary variable Q(k + 1) as 

Q(k + 1) = argmaxL (P,Q(k);u(k+l)) . (9) 

Remark 1: A straightforward method to solve © is the two-layer nested proximal point 
method 11371 . which can be expressed as follows: In the inner layer iterations, the transmission 
power variable P is optimized for fixed Q by Lagrangian dual optimization method, resulting 
in an optimization problem of Q. After the inner-layer iterations have converged, the auxil- 
iary variable Q is updated in the outer layer. Such a structure is not suitable for distributed 
implementation, because it is difficult to decide in a distributed manner when the inner-layer 
iterations have converged. On the other hand, the proposed Algorithm A has a nice single-layer 
optimization structure. The outer-layer update of Q does not request that the inner-layer dual 
updates have converged. 

Remark 2: If the traditional proximal point method is used to solve ©, the convergence 
analysis will not involve the dual variable v [|37l . because the inner-layer dual optimization has 
converged. However, in order to show the convergence of Algorithm A, we need to characterize 
the influence of the dual update ([8]). Therefore, it is more difficult to establish the convergence 
of Algorithm A. 

B. Distributed Implementation of Algorithm A 

We proceed to explain how to implement Algorithm A in a distributed fashion. In particular, 
we show that each step of Algorithm A only needs local information exchange among the source, 
relay, and destination nodes of each DF relay link. 
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First, the dual update © can be equivalently expressed as 



P s 
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which can be carried out distributedly at each source and relay nodes. Moreover, the Lagrangian 
maximization problems in © and © can be decomposed into many independent local power 
allocation subproblems. Specifically, the terms of the Lagrangian L in © can be reassembled 
as 



l{p,q-u 



M 



m=l ^ 

+ E[« 

i63(m) 



L mj r, 



V mj Tim]/ rj V ^6mj) 



J i=l J=l 

Therefore, the Lagrangian maximization problem in © and © can be rewritten as 
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{Pmj~Qmj) ~ f J 's(m)P m j~ l/ jP m j, (15) 

are local power allocation subproblems for the DT link and DF relay link, respectively. The 
closed-form solutions to (fl4l) and (fT5l) are provided in the following lemmas, where the subscripts 
are omitted for ease of notation: 

Lemma 1: The optimal solution to (fl4l) is 

P s = f(28 DT ,c,^Q s ,g s ' d A), (16) 



where 

f(6,c, l 2,Q,g,v)^U-^—-- + v ^ 2 T^-x) , (17) 

f* Q, 6 

x = + — j-^-TT' (18) 

f /ilnz 2g 

y _ 2Qfl | e 2 e 2 

fiv In 2 gfiln2 /i 2 ln2 2 
The proof of Lemma Q] is provided in Appendix lAl As c — > 0, ^ x 2 + y — x also tends to 0. In 
this case, (fT6l) reduces to the conventional water-filling solution. 

Lemma 2: The optimal solution to (TT5T) is provided for three separate cases: 
Case 1: if g r > d P r > (g s > r — g s > d )P s , the optimal values of P s and P r are given by 

P s = f(9 DF ,c,v,Q s ,g s ' r ,l), 
P r =[-u/c + Q r } + . 

Case 2: g r ' d P r < (g s > r - g s ' d )P s . If P r in (EQ) satisfies P r > 0, the optimal values of P s and 
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P r are given by 
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where e is the value of p s g s ' d + p r g r ' d given by 

, 2 . / _ j\ 2 



Otherwise, if P r in (12TI) is negative, the optimal values of P s and P r are given by 

P° = f(9 DF ,c,»,Q s ,g s > d ,l), 
P r = 0. 

Case 3: if g r > d P r = (g s ' r — g s ' d )P s , the optimal values of P s and P r are given by 

ps 



(22) 
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The proof of Lemma [2] is provided in Appendix |Bj 

Remark 3: The solution to (PT4)) requires only the CSI g s ' d and the latest dual variable [i of 
the source node. The solution to (TTST) requires only the CSI g s,T , g s,d , and g r ' d , as well as the 
latest dual variables fi and v of source and relay nodes. Therefore, Algorithm A only requires 
local information exchange among the source, relay, and destination nodes of each DF relay 
link. 

Remark 4: Subproblem (fTBl) has unique solution for all the values of the dual variables /x and 
v, thanks to the introduced quadratic terms. On the other hand, if c = 0, problem (HJ) reduces 
to the original problem (P), and the subproblem (fT5l) may have many optimal solutions. First, 
if v — c = 0, v/c in the expression of P r in (1201) can be an arbitrary positive number in [0, Q r j. 
Second, the source and relay power allocation in ((2~Tj) satisfies (see also (l56l) in Appendix |Al) 

\pi + c(P s - Q s )]g r ' d -[u + c(P r - Q r )]g s ' d = 0. (25) 



13 



If c = 0, we have g r,d p, — g s,d v = from ( |25l ). Therefore, both the numerator and denominator 
in the first terms of source/relay power in (|2TT) are zero, and the optimal source and relay power 
solutions are non-unique. Since no global network information is available when solving the local 
power allocation subproblem (fT5l) , it is quite difficult to find a global feasible solution among 
all the local optimal solutions. As a result, the power allocation variable will keep oscillating, 
although the dual variable converges to the optimal solution. 

C. Convergence Analysis of Algorithm A 

Let us define the stationary point of Algorithm A: 

Definition 1: A point (Q*, u*) is a stationary point of Algorithm A, if 

Q* = arg max L (x,Q*:u*) , (26) 

x>0 \ J 

EQ* - P max < 0, v* > 0, (27) 
v* <g> (EQ* - P max ) = 0, (28) 

where x ® y represents the hadamard (elementwise) product of two vecters x and y with the 
same dimension. 

Since problem (P) only has affine power constraints, it satisfies the modified Slater's condition 
iffOl . if it is feasible. The following result holds for the stationary point of Algorithm A: 

Lemma 3: If problem (P) is feasible, (Q*, u*) is a stationary point of Algorithm A, then Q* 
is one optimal solution to problem (P). 
Proof: Suppose that 

P = arg max L ( x, Q; v ) . (29) 

x>0 \ J 

According to the Karush-Kuhn-Tucker (KKT) condition ll40l . there must exist a subgradient 
VR(P) of R(P) such that 

VR (p\ - E T V - V [P - Q \ = 0. (30) 

By comparing (l26l) with (|29l , the following equation must hold for the the stationary point 

(Q*,u*): 

VR (q*) - E T v* = 0. (31) 
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Assembling d27T> , (|28l) , and CD}, the stationary point (Q*,u*) satisfies the KKT optimality 
conditions of problem (P). According to the modified Slater's condition, Q* is one optimal 
solution to problem (P) [@0]|. ■ 

By the concavity of R(P), we have 



VP P - VP Q 



P-Q*) < 



(32) 



The following key result can be viewed as an extension of the above inequality. 

Lemma 4: Let (Pi,/?i) and (P 2 , V 2 ) be the corresponding maximizers of the Lagrangian © 

for fixed Q, i.e. Pi = arg max L ( P, Q, 8; V\ J and P 2 = arg max L ( P, Q, 9; v 2 ) . If c m j is small 

p>o ^ / p>o ^ ' 

enough, then 



VP Pi - VP ( Q* 



< ]^{V 2 -V x f EV~ X E{V 2 



Pi 
z/i) . 



(33) 



where VP(Pi) and VR(Q*) are defined in (|30l) and ( |3TT ), respectively. 

Proof: See Appendix O ■ 

As we mentioned in Remark 2, a key step in establishing the convergence of Algorithm A is 
to characterize the influence of the dual update ®. In Lemma HI we established a relationship 
between two Lagrangian maximizers (Pi,Vi) and {P 2 ^v 2 ). Suppose that the dual variable is 
updated from v 2 to v\, if the step-size of the dual update between z7 x and v 2 is not large, the 
left hand side of (1331) will not be far above zero. 

A similar result to Lemma |U was obtained in 11381 . however we cannot use the arguments in 
ll38l to prove Lemma HI In particular, the arguments in |[38l require the following relationship 



and 



V P , R{P X ) - V P * P(Q*) (P^x - QZj) < 



V^i*(A) - Vp, P(Q*) (P^ - Q r *j) < 



(34) 



(35) 



Since P(P) is jointly concave with respect to P* • an d ^mr instead of (l34l) and (l35l) . we only 



have 



WW 



V R{Q*) 



P 



mj,l 



Qmj) 



+ 



Vp, p(A) - v P , p(q*) (p;^ - ) < o. 



(36) 
(37) 
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Therefore, new techniques are developed to show Lemma |4] in Appendix O 
Let us define the norm of dual and auxiliary variables: 



Hl^vW^, \\Q\\v = 



Q T VQ. 



(38) 



With Lemma HI we can use the Lyapunov drift techniques to prove the following theorem as in 

mi- 
Theorem 1: If the algorithm parameters c m , c m j is small enough, and the dual step-size a n 
satisfies 



1 • r 

maxtti < —mm{c m ,Crnj}, 

I 2o m,j 



(39) 



our proposed Algorithm A converges to a stationary point, i.e., one optimal solution to problem 
(P), where S is the maximal number of links that a source or relay node can participate, given 
by 

:<max (1 + J(m)) 

{m\s(m)=l} 

The proof of Theorem Q] is omitted here, because once Lemma @] is established, Theorem \T\ 
follows from combining it with standard Lyapunov drift techniques. For the readers' convenience, 
we provide details in our online technical report iHTTl . 



S = max < max 



, max 

3 


E i 


j 




{m\je3(m)}_ 





(40) 



IV. Numerical Results 

This section provides some numerical results of our proposed distributed power allocation 
Algorithm A. A DF relay network with 4 user (source/destination) nodes and 2 relay nodes are 
considered, with a network topology illustrated in Fig. [3] The channel power gain between two 
nodes is determined by a large-scale path loss component with path loss factor of 4. We assume 
that each source and relay node has the same amount of transmission power, i.e. P; s max = 
Pj,max = -^max for all l,j, and the received signal-to-noise ratio (SNR) at unit distance from 
a transmitting node is = 20dB. There are 5 data streams in this network (see Fig. [3]), 

that share the total time/frequency channel resource equally. If DF relay techniques are not 



employed, the channel resource proportion of each DT link is O^ 1 = jr. When both DT and DF 



iDT _ 1 
m 5' 

relay transmissions are allowed, data stream 1 can only make use of relay 1, but not relay 2, 
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Fig. 3. The topology of considered DF relay network. 
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Fig. 4. Convergence performance of our distributed power allocation Algorithm A. 



since g{$ < gt'2 ■ The other data streams can be assisted by both relay 1 and 2. The channel 
resource of each data stream is equally allocated to its DT and DF relay links. 

Figure |4] illustrates the convergence performance of our distributed power allocation Algorithm 
A. The algorithm parameters are c m = c m j = 10~ 4 , ol\ = 5 x 10~ 5 . The achievable rate of each 
data stream is shown in Tab. U for both the cases with and without DF relay techniques. The 
spectrum efficiency of each data stream increases significantly by deploying the DF relay nodes, 
and the total network spectrum efficiency increases 59.7%. 

Figure [5] provides the evolution of power allocation variables for the DT and DF links of data 



17 



TABLE I 

Spectrum efficiency of each data stream (bits/s/Hz) 





Stream 1 


Stream 2 


Stream 3 


Stream 4 


Stream 5 


w/ relay 


0.2700 


0.1347 


0.1702 


0.1293 


0.2313 


w/o relay 


0.1696 


0.0971 


0.0523 


0.0971 


0.1696 



1.2 




50 100 150 200 

Number of iterations 



Fig. 5. Evolution of power allocation variables for the DT and DF links of data stream 1. 
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Fig. 6. Evolution of power allocation variables for the DT link and one DF link of data stream 3. 

stream 1. Since user 1 (the source node of stream 1) is quite near to relay 1, user 1 only needs to 
spare a small proportion of source power to forward information to relay 1, and yet achieves a 
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high data rate improvement. Figure [6] further provides the evolution of power allocation variables 
for the DT link and one DF link of data stream 3. Since user 2 (the source node of stream 3) is 
relative far from relay 1, user 2 needs to utilize more transmission power in its DF relay link, 
so as to achieve a high data rate. 

V. Conclusion 

In this paper, we have developed a distributed power allocation algorithm to maximize the 
network throughput of DF relay networks. This problem is a convex optimization problem, 
where the objective function is not strictly concave. However, standard proximal techniques 
are not suitable because they resulted in a nested solution that is difficult to implement. We 
overcome this difficulty by developing an algorithm whose key feature is a single-layer iteration 
structure, which is desirable for on-line implementation. In each iteration, information exchange 
only occurs among the source, relay, and destination nodes of each DF relay link. We show that 
the algorithm converges to the optimal solution and study its efficacy via numerical evaluation. 
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When P s > 0, (|4T|) achieves equality, P s is thus the positive root of a quadratic equation 
equivalent with (14TT) ; otherwise, P s = 0. Summarizing these two cases, the value of P s is given 
by CE6]>. 



APPENDIX 



A. Proof of Lemma [7] 



The Karush-Kuhn-Tucker (KKT) conditions of d) imply 




(41) 
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B. Proof of Lemma [2] 



Let us define the rate functions 



Ri 
R2 







DF 



2 

QDF 



log 2 



2 (P s g s > d + P r g r ' d ) 
1+ IP* 



log 2 1 



2P>gS,' 



2 ~~ oz v ' e DF 

Therefore, the achievable rate of DF relaying can be expressed as R DF = min {Ri, R 2 } 
(fT5l) is equivalent to the following problem: 

s.t. t<R u t< R 2 , 
where R± and R 2 are defined in (l42l) and (l43l) . The Lagrangian of problem (l44l) is 

L(t,P s ,P r ;r,C,^) 
=t + r{R, -t)+ C(R2 -t)- C -{P°- Q s f 
-^(P r -Q r f-fiP s -uP r . 



(42) 

(43) 
Problem 

(44a) 
(44b) 



The KKT optimality conditions of problem (144)) indicate 

r > 0, i?i -t > 0, t(R 1 -t) = 0, 
C > 0, P 2 - t > 0, ((R 2 -t)=0. 
By (14"6l) . the Lagrangian (1431) can be simplified as 

L(P s ,P r ;r,n,v) 
=rR 1 + (1 - r)P 2 - £ (P« - Q s f ~\{P r - Q r f 
- /iP s - vP T . 

Moreover, from the KKT optimality conditions (I46l)-(l48l). we obtain 

if R\ > P*, r = 0; 
if RI < R* 2l r = 1; 
if R\ = R* 2 , < r < 1, 



(45) 

(46) 
(47) 
(48) 



(49) 



(50) 
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where R{ and P£ are corresponding rate values (1421) and ( |43l at the optimal power allocation 
solution. Therefore, problem (l44l) can be address by solving the Lagrangian maximization 
problem 

max L(P s ,P r ;r,u,v), (51) 

for the 3 cases expressed in (l50l) . 

Case 1: When R\> R* 2 , we have r = 0. The KKT conditions of (ED are 

o*. r f=0,ifP s >0 

^ + c{P s -Q s )l , (52) 



In2(l+2^) |<0,ifP s = 

= 0, if P r > 

i/ - c(P r - Q r ) { . (53) 

< 0, if P r = 



The solution to (1521) is similar to that of (1411) . Further considering (1531) . the optimal source and 
relay power is given by (|20l ). Note that Case 1 requires R* > R^, which can be equivalently 
expressed by g r > d P r > i y g s - T — g s < d )P s . 

Case 2: When R\ < R%, r = 1. The KKT conditions of (ED are given by 

s,d 

-ti- c(P s - Q s ) 



In 2(1 



2gs,dps + 2gr,dp 
QDF 



= 0, if P s > 
< 0, if P s = 



(54) 



r,d 

— -v- c (P r - Q r ) 



In2(l + 2 ^ P ;+F 



= 0, if P r > 
< 0, if P r = 



(55) 



If P s > 0, P r > 0, then ([34]) and ([55]) take equality. By viewing e = g s ' d P s + ^ r ' d P r as a 
whole body, we can get a quadratic equation of e from (l54l) and (1551) . which has a positive root 
given by (l22l) . Moreover, by comparing (l54l) and (1551) with equality, we obtain 

[fj. + c(P s - Q s )] g r ' d = [u+ c(P r - Q r )] g s ' d . (56) 



Substituting (1561) into (122)) . the optimal power allocation solution is derived as in (|2T[) . 
If P r = 0, (l54l) reduces to a formula similar with (|52|) . and its solution is given by (|23T) . 
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Note that Case 2 requires < R%, which is guaranteed by g r ' d P r < (g s>r — g s - d )P s . The 
case of P s = and P r > can not happen, since it violates the condition R* < R^. 
Case 3: If R\ = R^, the KKT conditions of (15TT) are given by 

(1 - r)g'> r 



rg ' 



\n2(l + ^ dp ^r dP l ^2(1+ 2 -^ 



fi - c{P s - Q 




r.d 



ln2(l+ 2 ^ dp ;+3 gr ' dpr ) 



v 



c{P r - Q r ) 



= 0, if P r > 
< 0, if P r = 



Since R\ — R%, we have 



g r,dpr = ( g s,r _ g s,djp 



(57) 



(58) 



(59) 



If P s > 0, P r > 0, both ([57]) and <|58]) achieves equality. By substituting ([59]) into $57} and (l58l) . 
we can eliminate r and derive the optimal values of P s and P r . Otherwise, P s = P r = 0. These 
two cases are summarized in d24l). 



C. Proof of Lemma 

We proceed to show the inequalities 



< 



1 



2c, 



■(/is(m),2 — A*s(m),l) , Vm, 



and 



< 



^P mj Rmj (Pmj,l) ~ V P mj Rmj(Qmj) [pmj,2 - Q* m j) 
1 



2r ■ 



[(a**M,2 - ^(m),i) 2 + 0"i,2 - ^',i) 2 ] , Vm, j, 



(60) 



(61) 



where P^ lj is the maximizer of (fT4l) corresponding to the multiplier ix s ( m ),i for i G {1,2}, and 



(P^j j, * s me maximizer of (fTST ) corresponding the multiplier (/i 



I/ha). The 



asserted result (1331) follows, if we take the summation of the inequalities (1601) and (1611) for all 
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the possible choices of m and j. Since R® T is a concave function of a single variable P^, the 
techniques of ll38l can be directly used here to prove (l60l) . In the sequel, we will show (|6TT) for 
each DF relay link. Since we only need to focus on one DF relay link, the subscripts m,j, s(m) 
are omitted in the sequel to facilitate our expressions. 

Let us associate Lagrange multipliers L s > and U > for the constraints P s > and 
P r > 0, respectively, in the maximization of ([TBI) . Using the Karush-Kuhn-Tucker condition, we 
can conclude that there must exist a subgradient ( — dp l , — dp } ' ) of R such that 

8R DF (P) 



Qps 

8R DF (P) 



-li- c(P s - Q s ) + V = 0, (62) 
v - c(P r - Q r ) + U = 0, (63) 



L S P S = 0, UP T = 0, (64) 

where P = (P s ,P r ) represents the source and relay power of the considered DF relay link. 
From (l30l) and (|3D) . we also have 

V P sR DF (P) -n- c{P s - Q s ) = 0, (65) 
V P rR DF (P) -v- c(P r - Q r ) = 0. (66) 



Comparing d62j) and d63j) with ((65]) and (|66j). we see that 

Let Q* = (Q s *, Q r *) be the the source and relay power at the stationary point. Similarly, we can 
obtain 

V P *R DF (Q*) = dRD * p { P + L", 

Vp^(g-) = ^y ) +L-. 
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Then, we further have 



T 



VR DF (P 1 ) - VR DF (Q*)\ (P 2 - Q*) 
dR DF {P l ) dR DF (Q*) 



gps gps 
dR DF {P l ) dR DF (Q* 



(Pi - Q s *) 

{PI - q 



gpr gpr 

+ (L{-L S *)(P^-Q S *) + (L[-L r *)(P^-Q r *). 
We can use the arguments in ll38l to show that 



(L\-L S *)(P°-Q S *) + (L\-L r *)(P 2 r -Q r *) 

<^ [(^2-^l) 2 + (^2-^l) 2 ]. 



Now we only need to show 



dR DF {P 1 ) _ dR DF {Q") 

Qps Qpa 

dR DF {Pi) _ dR DF (Q* ) 

gpr Qpr 



{Pi - Q") 

(PS - Q r *) 



< I [{»2 - /il) 2 + (V2 - Vlf\ 



for ([6B to hold. 

Let us further define 



_dR DF {P 1 ) 


dR DF {Q*) 


gps 


gps 


_dR DF {P 1 ) 


dR DF {Q*) 


gpr 


dP r 


_dR DF {P 2 ) 


dR DF {Q*) 


gps 


gps 


dR DF {P 2 ) 


dR DF {Q*) 



gpr 

For ease of notation, let us define 7 S 

„0 A 



gpr 



c(Pi-Pf) 



PI 


-Q s \ 


pr 


-Q r \ 


ps 


-Q s * 


pr 
r 1 


- Q r *. 




Tr j r 
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(67) 



3— > 'Y 



A 



7" = 1 + j r . Then, according to (1621) and (1631) . we have 

fl 2 ~ A*l = «2 - Q l + C ( & 1 - 62) + L 2 - 

= ( fl ;-a5)-c7j(6;-«4), 

^2 — ^1 = &2 ~ a l + C (^l — ^2) + -^2 — -^1 

= (a;-aS)-c7?(&;-65). 



7s, and 

(68) 
(69) 
(70) 
(71) 
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Moreover, (|67l) can be equivalently expressed as 



a{b s 2 + a[b r 2 < — (/x 2 - /^i) 2 + (v 2 
4c L 



The concavity of R in (P s , P r ) suggests 



aj&? + a\b\ < 0, a*&* + a r 2 b r 2 < 0. 



(72) 



(73) 



If afbf < and a[6[ < (i = 1, 2), one can show Lemma 0] according to the arguments in [|38l . 
However, rather than having < or a[&£ < 0, we only have (1731) . In order to handle the 
difficulty, we will discuss case by case to fully explore the structure of R DF defined in ©. In 
particular, we proceed the remaining proof by breaking into three levels of cases: 
1) Break into Case 1-7 based on all combinations of the signs of a{b{, a[b[, a 2 b 2 , and a 2 b 2 . 



2) In some cases, further break into subcases (I)-(IV) based on all combinations of the signs 
of a\b 2 and a[b 2 . 

3) In some subcases, further break into mini-cases (l)-(8) based on all combinations of Pi, 
Pi, and Q* lying in region or region (2), where region is defined as R DF = R\, i.e. 

gS ,dps + g r,dpr < g s,rps^ q is defined as R DF = R 2 , i.e. g s ' d P s + g r ' d P r > 

gS,r ps 

We will explain in detail how to prove (l72l) for each subcase and mini-case in Case 1, and 
also in relative detail for Case 2 to show that the proofs in Case 1 and Case 2 have similar 
logic. Since the techniques in Case 3-7 are quite similar with that used in Case 1, we will omit 
most of the similar steps without repeating the same proof logic. 
Case 1: When a\b\ > 0, a\b\ < 0, a s 2 b s 2 < 0, a r 2 b r 2 > 0. 

(I) We first assume a{b & 2 > 0, a\b r 2 > 0, then we have a{a & 2 < 0, b{b s 2 > 0, a\a T 2 > 0, b\b T 2 < 0. 
Now we further break into mini-cases: 
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(1) Pi is in region (T), P 2 is in region Q, Q* is in region Q. Then, 



1 1 + fG^Pf + g r ' d P[) 1 + f (<7 s,d <3 s * + g r > d Q r *] 

g r,d g r,d 



1 1 + l(g s > d P( + g r > d P[) 1 + §(# s - d Q s * + g r > d Q r *) ' 

b\ =p 1 s - q s \ b\ = p[ - q\ 

a s 



r 



i + l(g s ' d Pi + g r4 Pl) i + Ug s4 Q s * + g r ' d Q r *) ' 

gT-,d gT,d 



2 ~ 1 + l{g s > d Pi + ^i?) 1 + l(g s > d Q s * + g r ' d Q r *) ' 

b s 2 =p 2 s - q s *, ^ = pi - Q r *. 

If b{ > and 6£ < 0, then we must have 6| > and b r 2 > from foffe| > and b\b r 2 < 0, 
respectively. From the format of a 2 , we further get a 2 < 0, which contradicts a r 2 b r 2 > 0; 
If b\ < and 6 J > 0, then b 2 < and ^ < 0. Further, from the format of a 2 , we have a 2 > 0, 
which contradicts aJJ&ji > 0; 

If 6* > and b\ > 0, then from the format of a{, we have a\ < 0, which contradicts a\b\ > 0; 

If b{ < and ^ < 0, then a\ > 0, which contradicts af 6f > 0. 

Thus, mini-case (1) is impossible under Case 1. 

(2) Pi is in region Q, P 2 is in region (2), Q* is in region 0. Then, 

gS,d g S,d 



1 1 + l(g s > d P! + g r > d P[) 1 + - e {g s > d Q s * + <f' d Q") ' 

r,d r,d 

a 



1 ~ 1 + + ) 1 + |(^ s ' d Q s * + ^ d Q"; 

b{ =Pl - Q s \ b\ = P{ - Q r *, 

aS g s > r g^ 

° 2 1 + §<?^P| 1 + l(g s > d Q s * + g^ d Q r *) ' 

g r ' d 



r _ 

° 2 " 1 + %(g s < d Q s * +g r > d Q r *Y 
b s 2 =P 2 S - Q s \ b r 2 = P r 2 - Q r *. 



Since a 2 < 0, we get b 2 < from a 2 b 2 > and b\ > from 6^63 < 0- Suppose 6^ > 0, then 
from the format of af, we have < which contradicts a\b\ > 0, so b{ < 0. By b\b 2 > 0, we 
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slope = - §— >0 

g'' 



region I 



P' 

Fig. 7. 



also have b 2 < 0. With the above facts and Figure. [7J we have P 2 — P\ » i- e -' ^2 — — 0- ^ ^ s 
apparent that a 2 < a\ < 0, and a\ < < af. 

Suppose P{ = 0, then P\ is on the boundary of region (T) and (2), and it belongs to mini- 
case (4) later. Without loss of generality, let P* 7^ 0, and then L\ = 0, (a 2 — a\){L 2 — Lf) = 
(a| - af)L| > 0. Similarly, P r 2 ± 0, L 2 = 0, and (a^ - a^)(L^ - LJ) = (a£ - a r 2 )L\ > 0. Also, 
af b{ + a\b\ + af&2 + a 2^2 < 0- Thus, we have 

1 



4c 



(A*2 - fJ-i) + O2 - v\Y - a\b s 2 - a\b T 2 



2 



K n s „ s) 2 , [c(&; - y 2 ) + - l;] 

"4? G2 ° lj + 4^ + 

^ 2 -a\){Ll-L\)- 1 -{a\b s 2 -a s 2 b\)+ 

4?° 2 aJ + 4^ + 

- - LD - \{aW 2 - a^)- 

~(a;&; + a;&; + a£&£ + a£&S) 

>—{a T 2 - a\f - ^{a{b s 2 - a s 2 b{ + a\b r 2 - a r 2 b[). 

We want to choose c carefully such that the above term is nonnegative. Since Q* is feasible 



and Q s * should be bounded by P^, we have a\b s 2 — a s 2 b\ < — 



9 • Q 1 9 ' W° < 

'j(g s ' d Q s *+g r - d Q r *) l+§ 9 s > r i| - 



9 s ' r P^- Similarly, - 0565 < ££f± and (oj - a^) 2 = ( i+foJ^V'fT) ) > 
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Thus, if i > |- 



c < 



I_i_ n s ' r P s 
y max 



-, i.e., 



1 4~ — n s ' r P s 



1 + 2g a > r P 1 



s 

max 



n g s,r_ g r,d 

£ ~m — 



we have a\b s 2 + a\b r 2 < ± (// 2 - A^i) 2 + O2 - ^i) 2 • 

Note that this direct argument is not general to other cases since (a 2 — a[) 2 may not have a 
positive lower bound if P 1 and P 2 are very close. So, breaking into cases is still necessary. 
(3) Pi is in region (2), P 2 is in region Q, Q* is in region Q. 



.9 



r 

a \ — — 



1 + Ig^Pl 1 + f^Q** + g*>*Qr) 

g r4 



\(g s > d Q s * + g r - d Q r *^ 



b\ =p 1 s - g s *, = P{ - Q r 

1 

«2 



0* 



5 



9 r ' d 

~ 1 + l(g s > d Pi + g^) ' 



]( g s,dQs* _|_ g r,dQr*y 

9 r4 

\( g s,dQs* + g r,dQr*y 




Since < 0, we have &i > from < 0, and aJJ > from a^a^ < 0. Suppose 6* < 0, 
from the format of a\, we have > 0, which contradicts a\b\ > 0, so b^ > 0. Further, we have 
a\ > 0, a 2 < 0, b 2 > by > 0, a^a^ < and b{b 2 > 0, respectively. Suppose b 2 > 0, by 
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the format of a 2 , a 2 < 0, which contradicts a 2 b 2 > 0, so b 2 < and a 2 < 0. If P( — 0, we 
have <5 S * = from 6f, which leads to triviality. Similar with mini-case (2), to avoid triviality, 



let P{ ^ 0, PI ^ 0, then L* = = L s 2 = and (a£ - a\){L r 2 - L\] 



a\)U 2 > 0. 



In this case, in order to apply the direct argument as in mini-case (2), we need a constant 

g s -T —g s J^-J- — g s i r g s id [Q S * P s fi s ; r n r ,df~) r * 



bound for P(, P{", P 2 . Since a\ 





PI < 



< 



2 g s,r g s,d 
1 



(9 s 



( 1+ ^ g s,rps ) ( 1+ 2 {gS , dQst+gr , dQ „y ) 



P s }-\-£n s > r n r > d Q r * 

> 0, we obtain 



9 



IsF^QT + lg s ' r g r ' d Q r *) 



9 



s,d\ 



2g s ' r g s 

which is a constant bound for P(. Note that 



P° 



pr 

max 



a\b s 2 + a\b r 2 

{al-a s 2 )-c 1 s (bl-b s 2 )](b s 2 -b{) + 
a s 2 b s 2 + a\b\-a s 2 b\-c 1 ° s {b s 2 -b\) 2 + 
(a r 1 -a r 2 )-c 1 ° r (b[-¥ 2 )](b r 2 -b r 1 ) + 

a r b r + a r b r_ a r b r_ cl 0^r_ b r^ 

=( fl2 - fll )(b s 2 -bl)-c 1 ° s (b s 2 -bl) 2 + 
(^-^){b r 2 -b r 1 )-c 1 ° r {b r 2 -b r 1 ) 2 + 
a 2 b 2 + a{b{ - a 2 b{ + a 2 b 2 + a r ^b\ - a^bl 

a 2 b 2 + a\b\ - a s 2 b\ + a 2 b r 2 + a\b\ - a 2 b\ 



If a 2 b 2 + a\b\ — a 2 b{ + a 2 b 2 + a[b[ — a r 2 b\ < 0, we are done, so we assume a 2 b 2 + a{b\ 



31 



a 2 b{ + a 2 b 2 + a\b[ — a r 2 b\ > 0. Recall that a 2 < af , a\ < a 2 and a|&| < 0, we have 
(a{ — a 2 )bl + a 2 b 2 > —a 2 b 2 + (a 2 — a r ^)b r x > —a 2 b 2 

(Pi - P^)g s ' d g s ' d Pi 



> 



> 



l-\-i(a s , d P s + n r > d P r 

1 T 9 W 1 max ~ il 1 ir 
2 



„s,d jds 

y r 2 



l + ±( a s,dps + a r,dpr 
^ ~ KM 1 max ~ y 1 mi 

„s,d ps 

y max 

1 + 2/ a s,dps i a r,dpr 
x fl li/ - 1 max ~ J m 



1 + §( MP| + M P , 




2 



max/ 

Also, (af - a|)6f + a£&£ < g"> r P{ + # r ' d P max = # s ' r Xf + g r ' d P^ ax . Combined with the above 
inequality, we have 

2 



Pi < 



1 + -(n S ' d P S 
' q Viz max/ 

1 

+ ^ + 



X 



g g r m . 



n s,d ps 
y max 



2 l + |(^max + ^m; 



X —d = X 2 
gs,d 



which is a constant bound for PS. Further, 



> 



al - a s 2 )b{ + a r 2 b r 2 > K - a^bl 

,r,d 

pr 



1 + 1(^X1 + ^ 



r 

max/ 



we then obtain 



P{ < 



l + -{g^X s 2 +g^ m[ 
= X[ 



(g^ + g^J 

n r,a 



which is a constant bound for P{. Now we can use the direct method as in mini-case (2), a\ b 2 

a s 2 b{ + a\V 2 - a\b\ < g s ^X s 2 + g s > d X{ + g r > d P^ + g r >*X{ and (a r 2 -a\f>{ 
Thus, if f > ^i+^f+^^x+^r , i.e., 



c < 



1+ 'j(gS,dXI + gr,dXr). 



2(g>>rX$ + g s > d X( + g^P^ + g^X[] 



a 



2- 
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we have afb 2 + a\b 2 < ± (/i 2 - fii) 2 + (u 2 - V\)' 
(4) Pi is in region (2), P 2 is in region (2), Q* is in region 0. 



,s,d 



A n s,rps 



)( g s,dQs* + g r,dQr 



T 

a-i 



1 + j(g s ' d Q s * + g r ' d Q r *" 



b\=p°-Q s \ h\ = P[-Q 



9 s 



9 



s.d 



1 + § <?^P| 1 + I (g s > d Q°* + <f> d <y 
<7 r ' d 



b s 2 =Pi 



+ i(g s ' d Q s * + g r ' d Q r *) 
Q s \ b T 2 = P 2 r -Q r *. 



Since < 0, a 2 < 0, then 6^ > and b 2 < 0. Suppose b\ < 0, then a\ > which contradicts 
a^&f > 0, so 6f > 0, 6 2 > and a 2 < 0. Now b 2 > and ^ 0, then it is impossible to place 
P 2 in region (2) and Q* in region Q at the same time. So mini-case (4) is impossible under 
Case 1. 

(5) Pi is in region (T), P 2 is in region Q, is in region (2). 



a 



5 



a 



1_ l+|(^p f + gr,dpry 

b s 1= pi-Q s *, b\ = p[-q 
9 s4 



l + Ug s > d Pi + g r ' d P£) l + h s > r Q s 



\(g^Pi + g^P 



b s 2 =P 2 s -Q s \ b r 2 = P 2 r -Q r *. 

Since > and aJJ > 0, then b\ < and 5 2 > 0- Suppose b\ > 0, then a\ < which 
contradicts af 6f > 0, so 6* < 0, b 2 < and a 2 > 0. Now b 2 < and 6 2 > 0, it is impossible to 
place P 2 in region Q and in region (2). So, mini-case (5) is impossible under Case 1. 
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(6) Pi is in region ®, P 2 is in region (2), Q* is in region (. 
In this case a 2 = 0. By using the result < 0, we have 



a\¥ 2 + oJ&£ 
<a\¥ 2 ^ 
1 



C7 o 



C7. 



a\¥ 2 - 



t l u '2 



C7r 



< — { (fJL 2 - fijal - {aft 

c 1s 



¥ 

"2 



al)a{ > + 



a\)a\ 



+ — \(u 2 -u 1 )a[-(a[r 



+ (a^bl + a\b\) 



1 

< — 

~4c 



O2 - Mi) 2 + O2 - "if 



where in the last step, we have used 7° = 1 + 7 S > 1, 7° = 1 + 7 r > 1, and af&f + aftl < 0. 
(7) Pi is in region (2), P 2 is in region (T), Q* is in region (2). 

In this case a\ = 0, then from a{bl + < 0, we have af 6f < 0. Further, since a\¥ 2 > 0, we 
have b\b 2 < 0. In view of the result ¥¥ 2 < 0, we then have 

a\¥ 2 + 

<a{bl-cf s blbl + a\bl- C1 %b r 2 
= [(al - a s 2 ) - C1 °M ~ b s 2 )] b s 2 
+ [{a\ - a r 2 ) - c Tr °(6I - &£)] 6$ 



+ («2 - ci%)b s 2 + (a£ - C7 P U 65)65 
<^ 2 -^)¥ 2 - cl °Mf+ 

[V 2 - ^2 - C7.W + («2&2 + « 
(/i 2 - /il) 2 + (^2 - ZA) 2 



1 

< — 

~4cL 



(8) P\ is in region (2), P 2 is in region (2), Q* is in region (2). 

= 0, a'^ = 0, af&f < 0, a 2 b 2 < 0, then af&2 + a^Ki = a i^2' an d me techniques in ||38 
applies. 
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(II) If a\b s 2 < and a\b r 2 < 0, then is is trivial. 

(III) If a{b s 2 > and a\V 2 < 0, then let 7 S = > and 7 r = < 0. 



a\b s 2 4 < (1 + i s )a\b s 2 4 (1 4 7 >^ 



C7, 

^{ [( fl ; - a£) - c 7r °(^ - & r 2 )K + { C1 % - <K} 

<^[(/i 2 -/ii) 2 + (^-^i) 2 ]. 

(IV) If a\b 2 < and a\b 2 > 0, it can be dealt with similarly as above. 
Case 2: When a{b\ < 0, a\b\ > 0, a s 2 b s 2 > 0, < 0. 

(I) If a{b & 2 > and a\b r 2 > 0, then we have a{a & 2 > 0, b\b s 2 < 0, a\a r 2 < 0, > 0. Now we 
further break into mini-cases: 

(1) Pi is in region Q, P 2 is in region Q, Q* is m region 0. 



a 2 



b s 2 



14 


|(^4 


g r,d P r) 


1 4 - g {g s > d Q s * 4 g r ' d Q r *Y 




g r,d 




g r,d 


14 


■l(g s ' d P( + 


g r,d P r) 


1 4 ^{g s4 Q s * 4 g r ' d Q r *Y 




- Q s *, 6; 


pr 

— r \ 


Q r * 




g s,d 




g s,d 


14 




gr^pr) 


1 4 §o d g s * 4 g r < d Q r *y 




g r,d 




g r,d 


14 


l(g s > d Pi + 


gr4 P r) 


1 4 - g {g s > d Q s * 4 g r > d Q r *y 


—^2 


- Q s \ b r 2 


_ pr 
_ r 2 


Q r *. 



If b\ > and 6^ < 0, then b 2 < and 6 2 < 0, and we further have a 2 > and a 2 > 0, which 
contradicts a 2 b 2 > 0; 

If < and b\ > 0, then fe 2 > and b 2 > 0, and we further have a 2 < and a 2 < 0, which 
contradicts a 2 b 2 > 0; 

If b{ > and ^ > 0, then a\ < and a\ < 0, which contradicts > 0; 
If fef < and b[ < 0, then crj 1 > and a[ > 0, which contradicts a[b\ > 0. 
So mini-case (1) is impossible under Case 2. 
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(2) P 1 is in region (T), P 2 is in region (2), Q* is in region Q. 



5 



.s.ci 



9 



1 1 + f^Pf + g r > d P[) 1 + §(<r> d Q s * + g r > d Q r *] 

.r,d 



g 



g 



1 1 + %{g'> d P{ + g r > d P[) 1 + l(g s > d Q s * + g r > d Q r *) ' 
b{ =P» - Q s *, b\ = P[ - Q r * 

s = g s ' r 

° 2 1 + lg s ' r Pi 1 + - e {g s - d Q s * + g r ' d Q r *) ' 

g r ' d 



1 + l(g s4 Q s * + g r ' d Q T 



b s 2 =P° - Q s \ b\ = PZ-Q 




Since a r 2 < 0, we get b r 2 > by < and b{ > by ^ > 0. Suppose b{ > 0, 

then a\ < and < 0, which contradicts > 0, so b\ < 0. Then, b 2 > 0, a\ > 

0, > 0, a 8 2 > 0. Without loss of generality, let P( > 0, P{ > 0, P| > 0, P 2 r > 0, so 

Lf = LI = L\ = U 2 = 0. Note that P( < Q s * < P* ax and P{ < ^— r^-Pf = ^— ^P^x- 
Since n s - 9 s - r -g^g s - r 9°' d (Q s *-Pi)+h°- r 9 r < d Q r * > Q , • 



which is a constant bound for P 2 . Use the similar idea as in Case 1. Without loss of generality, 
assume a 2 b 2 + a\b{ — a 2 b\ + a 2 b 2 + — a 2&i > 0' tnen a 2^2 — a 2^i + a i^i ~~ a 2^i > — a !&i ~~ 
a r 2 bl > > i + 4^pL^p^Y A1s °' ~ b ^ + ^ " ^ I + = 
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{g s,r _ gs^p^ then 



-gr,d 



+ (g s > r - g'^P, 



s 

max 



l + -(n s > d P s +n r ' d P 
' Q\" max 1 



r,d r>r > 
max; 



pr 



=x r 2 



which is a constant bound for P 2 r . Thus, if f > 1 g s ' d *|+g s ^ ax +g r - d * 2 r +(g s ' r g s ' d )^ ax A c 



• i A-A n s,r ps 
'7f" max 



(3) Pi is in region (2), P 2 is in region (T), Q* is in region Q. 



2 s 



1 l + fg^Pf 1 + - e {g s ' d Q s * + c/ r - d Q r *) 
a x = — ■ 



Kr,s,dQ8* _|_ g r,dQr*y 



b\ =P s l -Q s \ b\ = P[-Q 

a: 



r 

a 2 



9 



g 



i + l(g s ' d Pi + g r > d PS) i + f (<? M <2 S * + g r ' d Q T 
b s 2 =p 2 s - Q**, b\ = pi - Q r *. 



slope = j— > 

g ' 

region 2 

region 1 

. Q" 



Fig. 10. 

Since a\ < 0, we get b\ < and b r 2 < 0. Suppose b 2 < 0, then a 2 > and > 0, which 
contradicts a 2 b 2 > 0, so b 2 > 0, frj 1 < 0, > 0, a| > 0, a 2 > 0. Without loss of generality, let 
P{ > and P| > 0, so L\ = and = 0. Further, Pf < P|, then a s 2 < a{, so (a|-af)(-Lf) > 
and (a£ - a J)L5 > 0. Note that P( < Q s * < P max , P{ < Q r * < P^ ax , P* < Q r * < P^ ax , and 



37 



n s _ n s,d %[g s ' d (Q a * -P£)+g r ' d (Q r * -P£)} > n p s < r\s* , 9 r ' d f^r* _ ps _i_ g r ' d pr 

"2 - y l 1+ -j {gS ,dp^ + gr,dpr) ][1 + j {gS ,dQs, +g r,d Q r* }] d- U > ^2 ^ V + V ~ ^max g s,d 

g s,rlps t£<pT )_i_ g s,dps + „r,dpr +g r,dpr 
t .pi 1 y \ max 1 s d max/ 1 y max 1 y max 1 y max 

Thus, if ^ > i ; 2 _j > 1-e-j 



a t y \ r max i gS ,d max J~y ' max J 

( „ ^ V 

1 \l+|(j M ^axW' d ^ax); 



c <- 



(4) Pi is in region (2), P 2 is in region (2), Q* is in region Q. 



1 i + |^' r Pf i + Uy s,d Q s * + # r>d Q r *) ' 



g r,d 



l ~ 1 + l(g s ' d Q s * + g r > d Q r *Y 
b{=P°-Q s \ b\ = P[-Q r * 

g s,r gS ,d 



2 1 + §<^P| 1 + | (^ d Q- + 

g r ' d 

a 2 = 



1 + - {g s > d Q s * + g r ' d Q r *)' 
b s 2 =P°-Q s \ U 2 = P 2 r -Q r *. 

a\ = a 2 < 0, this contradicts a\a r 2 < 0. So mini-case (4) is impossible under Case 2. 
(5) Pi is in region 0, P 2 is in region 0, Q* is in region (2). 



r, d 



9 

a 



1 +r^r: 



b{=pz-or, b[ = p[-Q r * 

s,d s,r 

a s - 



i + l(g s ' d Pi + g r ' d P%) i + - 9 g s ' r Q s * ' 
g r4 

b s 2 =P 2 s -Q s \ b r 2 = P r 2 -Q r *. 
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a\ > 0, a 2 > 0, this contradicts a\a r 2 < 0. So mini-case (5) is impossible under Case 2. 
(6),(7),(8) are all similar as in Case 1. 

(II) If a\b s 2 < and a\b r 2 < 0, it is trivial; 

(III) If a\b s 2 > and a\b r 2 < 0, then let 7 S = > and 7 r = < and similar 
argument as in Case 1 follows; 

(IV) If a\b 2 < and a[b 2 > 0, it is similar as above. 
Case 3: When a{b{ < 0, a\b\ > 0, a s 2 b s 2 < 0, a r 2 V 2 > 0. 

We only prove for the subcase when a\b 2 > and a\b 2 > 0. The same proof ideas as in Case 1 
can be applied in all other subcases. 

Let 7 s 4 g| > and 7 r = ^ > 0, then 

a\b s 2 + a\b r 2 

<(l + 7>^ + (l + 7 r »2 

= [(al - a s 2 ) - C1 °M ~ K)] (b s 2 -K) 

+ [K - 4) - c 7r °(&I - V 2 )] {¥ 2 - b{) 

+ {a{b\ + a^) + {aWi + a£&£) 

-c7°(^-^) 2 -c 7r °(^-6D 2 
<(Ai2-A*i)(65-6;)-c7j(6S-^) 2 

+ (v2-viW 2 -b r l )-c 1 ° r (b r 2 -b r 1 ) 2 

+ (albl + a^bl) + (a s 2 b s 2 + a r 2 b r 2 ) 
1 



< 
_ 4c 



(/i 2 - /ii) + {v 2 - v x y 



Case 4: When affe^ > 0, a\b\ < 0, > 0, a r 2 V 2 < 0. 
The similar argument as in Case 3 can be applied here. 
Case 5: When a^l < 0, a\b\ < 0. 

We only prove for the subcase when a\b s 2 > and a\b^ > 0. The same proof ideas as in Case 1 
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can be applied in all other subcases. Let 7 s 



>o, Y 



> 0, then 



a[b s 2 + a\b r 2 

<(l+ 7 >^ + (l + 7 r K^ 
= [(a\ - a s 2 ) - cj°M - b s 2 )] b s 2 

+ [(oj - a5) - ct?(6I - 65)] ¥ 2 

+ (4 - crX)b s 2 + (« r 2 - ct?«5)65 
< (At2 _ ^ _ C7 o ( ^ )2 + (i/2 _ ^ l)fe r _ C7 o ( ^ )2+ 



(a|6| + a^) 



1 

< — 



(fl 2 ~ /il) 2 + (>2 - 



Case 6: a s 2 b s 2 < 0, < 0. 



We only prove for the subcase when a\b 2 > and a\b 2 > 0. The same proof ideas as in Case 1 



can be applied in all other subcases. Let 7 s = - 

a\b s 2 + a\b r 2 

<(l + 7 >^2 + (l + 7 r Kfr 
1 



>0, 7 r 



> 0, then 



n. 
1 

n 



[(at - a s 2 ) - C1 °M - b s 2 )] a{ + ( C1 % - a\)a{ + 



[(a\ - a r 2 ) - C1 ° r (bt - b r 2 )] a\ + ( C1 % - <K 



CJs 

1 
C7° 
1 

< — 

~Ac 



— 777T l 



(>2 - /il) 2 + (>2 - Vxf 



Case 7: When atbt > 0, > 0; or a 2 b 2 > 0, a 2 b 2 > 0. This case can not happen, otherwise, 
it contradicts (I73T ). ■ 



